Development of an Intelligent Omnivision Surveillance System

This paper describes an innovative intelligent omnivision video system, that stitches the images of four cameras together, resulting in one seamless image. This way the system generates a 360 degree view of the scene. An additional automatically controlled pan-tilt-zoomcamera provides a high resolution view of user defined regions of interest (ROI). In addition to the fusion of multiple camera images, the system has intelligent features like object detection and region-of-interest detection. The software architecture features configurable pipelines of image processing functions. It is easily possible to rearrange the pipeline and add new functions to the overall system. The pan-tilt-zoom camera is controlled by an embedded system, that has been developed for this system. GPU-accelerated processing of elements allows real-time panorama stitching. We’re showing the application of our system in the field of surveillance, but the system can also be used for robots.